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Review of Sum of Squares (SOS) Polynomials 


Checking whether a polynomial is SOS 


A polynomial p with degree < 2d is a sum of squares if and only if 
there exists Q = Q! > Ost. 


p(x) = 2(x)"Qz(x) (1) 
where z(x) is the vector of all monomials of degree < d: 
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Find a particular solution Qo such that 
p(x) = 2(x)" Qoz(x), 
and find a basis of symmetric matrices N;, j = 1,2,--- ,K, such that 
z(x)™Njz(x) =0 forall x. (2) 


Then p is SOS if and only if there exist reals 11,--- , Ax such that 
K 
Q=Q+ ) AN; 20. (3) 
j=l 


This is a linear matrix inequality (LMI) and can be solved numeri- 
cally with standard semidefinite program (SDP) solvers. 


Synthesizing SOS Polynomials 


Given p;,i = 0,1,---,m, each with degree < 2d, find reals a1,--+ , am 
s.t. po +4 ,p1 +++: +4mpm is SOS. 


Find a particular Q; satisfying pj = z'Qj,z for each i = 0,1,--+,m. 
Then search for 41,--- ,am and A1,--- ,Ax satisfying the LMI 


m K 
Qo+ }) aiQi + Yo A;N; = 0. (4) 
i=l j=l 
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Applications 


Searching for a Lyapunov Function 


Given x = f(x), f(0) = 0, where f is a vector of polynomials, search 
for a Lyapunov function of the form 


V(x) = po(x) + a1pi(x) +++ + amPm(2) (5) 


where pj,i = 0,1,---,m are basis polynomials selected ahead of 
time, and a;,i = 1,--- ,m are weights to be determined. 


To ensure V is positive definite, pick a positive definite polynomial ¢ 
(e.g., £(x) = ex’ x for some small e) and impose the constraint: 


V(x) — €(x) is SOS. (6) 
To ensure VV (x)! f(x) is negative semidef., impose the constraint: 
—~VV(x)" f(x) is SOS. (7) 


Constraints (6) and (7) can be brought to the LMI form (4) and feasi- 
ble a;,i = 1,--- ,m can be determined numerically (if they exist). 


Overapproximating Reachable Sets 


Recall from Lecture 15 that 


Rre {x(7) | x = f(x,u), x(0) =0, [ ul (t)u(t)dt < i} (8) 
defines the reachable set from x(0) = 0 under unit energy inputs and, 
if we can find a positive definite V such that 

VV(x)"f(au) Sulu, (9) 
then we can overapproximate Rr by: 

Rec {xe V(x) < 1}. 
This follows because, from (9), 


4 v(x(t)) <u'u => V(x(T))—Vix(0)) < [ ul (t)u(t)dt <1 
dt ~ =e ~ 


=> V(x(T)) <1. 


If f(x,u) is a vector of polynomials in x and u, we can search for a 
polynomial V of the form (5), and encode (9) with the constraint: 


~VV(x)" f(x,u) +u7u is SOS in x and u. (10) 


This can then be combined with (6) and brought to the LMI form (4). 
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Certifying Safety n 

If unsafe set U does not intersect the overapproximation above, then ca 

it can’t intersect the actual reachable set. Thus, we can certify safety 

by proving the implication: > 
xeuU => V(x) >1+e (11) fx|v(x) <1} 


for some ¢ > 0. 


Suppose the unsafe set can be expressed as 
U= eign) S02 Hl ph 


where g; are polynomials. Then we can encode (11) with the con- 


straints: 
V(x) —(1 +e) - y s;(x)qj;(x) is SOS (12) 
i=1 
si(x), i=1,---,p are SOS. (13) 


We can parameterize the search space for s; as we did for V in (5), 
and combine (6), (10), (12)-(13) into a LMI. 


Above we implicitly used a generalization of the S-procedure from 
Lecture 15. Specifically, to prove that 
go(x) >O whenever qj(x) >0,i=1,2,...,p 


we look for nonnegative functions s$1,59,...,8 p (rather than constants 
as in Lecture 15) such that 


Underapproximating the Region of Attraction 


Given system x = f(x) with asymptotically stable equilibrium at the 
origin x = 0, the region of attraction, denoted R,4, is the set of initial 
conditions from which the trajectories converge to the origin. 


Recall from Lecture 10 that, if V is positive definite and 
VV (x) f(x) <0 whenever x 40 and V(x) <7, (14) 
then OQ, = {x: V(x) <7} C Ra. 


Let £ be a positive definite polynomial. If there exists a SOS polyno- 
mial s such that 


—[E(x) + VV(x)" f(x)] — s(x) l7 — V(x)] is SOS, (15) 
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then V(x) < y implies VV (x)! f(x) < —£(x) as stipulated in (14). 


To obtain a LMI from (15), one option is to fix the Lyapunov func- 


tion? V and to parameterize the search space for s. We can further > choose, e.g., a quadratic Lyapunov 
maximize ‘y subject to (15) by incrementing until the the resulting iia pontine lifeatieed svorel st 


LMI is infeasible. 

Alternatively s can be fixed and V parameterized. If we parameter- 
ize both s and V, however, (15) is no longer affine in the parameters 
because the term s(x)V(x) contains the products of these parameters. 

Below is a procedure that alternates between first fixing V, varying 
s, and next fixing s, varying V. When a new V is obtained, however, 
the shape of the level set changes and it may be ambiguous whether 
the new one is bigger. To remove this ambiguity we define a "shape 
function” p and use its level sets to judge the size of the region of 
attraction estimate. 


Step 1: Let Vo(x) be an initial choice for a Lyapunov function, e.g., a 
quadratic function for the linearized model at the origin. Find 


y*:=maxy s.t. VVo(x)' f(x) <0 whenever x 4 0 and Vo(x) < 7. 

To satisfy the constraint look for a SOS multiplier s;(x) that satisfies 
—[e(x) + VVo(x)" F(x)] — s1(x) fy — Vo(x)] is 80S 

where is positive definite, e.g., (x) := e(x? + x5) for some € > 0. 


Step 2: Let p(x) be some fixed, positive definite convex polynomial 
(c.g., p(x) = xt + x5), and let Vo(x) and 7* be as in Step 1. Find 


B* :=maxB s.t. Vo(x) < y* whenever p(x) < B. 
To satisfy the constraint look for a SOS multiplier sz(x) such that 


[y* — Vo(x)] — s2(x)[B — p(x)] is SOS. 


This means that {x : p(x) < B} is contained in {x : Vo(x) < 7*}. 


Step 3: Given y*,s1(x) from Step 1 and p(x),s2(x) from Step 2, 
search for V(x) to solve: 


Bo0 P 
4th-order V(x) 
subject to V(x) — €(x) is SOS 
~ [e(x) + V(x)" F(2)] — 51 (2) [97 — V(x)] is SOS 


[y* — V(x)] — s2(x)[B — p(x)] is SOS. 
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The first constraint ensures V is positive definite. The second im- 
plies that the level set {x : V(x) < 7*} is invariant, hence a valid 
approximation for the region of attraction. The third constraint and 
the maximization of 6 ensure that V is selected such that the level set 
{x: V(x) < 7*} is as large as possible, as measured by function p. 


To proceed, replace Vo(x) in Step 1 with the function V(x) from 
Step 3, and repeat the steps above for several iterations, until the 
change in f* in Step 2 is sufficiently small. The final approximation 
of the ROA is the set where V(x) < 7*. 


